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WHAT IS CLAIMED IS: 

1. A speech synthesizing apparatus comprising: 

storage mjeans for storing plural items of phoneme 
data; / 

retrievafl. means for retrieving phoneme data, in 
accordance wi/th given retrieval conditions, from the 
plural items/ of phoneme data stored in said storage 
means ; / 

first /penalty assigning means for assigning a 
penalty that is based upon an attribute value to each 
item of pfhoneme data retrieved by said retrieval means; 
and / 

seliection means for selecting, from the phoneme 
data reprieved by said retrieval means, and based upon 
the pen|&lty assigned by said first penalty assigning 
means , /phoneme data to be employed in synthesis of a 
speeco waveform. 

2. The apparatus according to claim 1, wherein said 
storage means stores respective items of attribute 
information together with the plural items of phoneme 
data; and 

said first penalty assigning means obtains an 
attribute value from the attribute information stored in 
said storage means. 

3. The apparatus according to claim 2, wherein the 
attribute information includes phoneme environment. 
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phoneme boundary, fundamental frequency, power and 
phoneme duration . 

4. The apparatus according to claim 1, wherein said 
retrieval means retrieves phoneme data that satisfies a 
specified phoneme environment. 

5. The apparatus according to claim 1, wherein said 
retrieval means retrieves phoneme data that satisfies a 
specified phoneme environment and fundamental frequency. 

6. The apparatus according to claim 1, wherein said 
first penalty assigning means sorts retrieved phoneme 
data based upon a prescribed attribute value and assigns 
a penalty value on the basis of order obtained by 
sorting . 



to claim 1, wherein said 
ssigns a penalty using 
achr' item of phoneme data 



7 . The apparatus according 
first penalty assigning mearjs 
power and phoneme duration qf 
as the attribute values. 

8. The apparatus according to claim 1, wherein said 
first penalty assd/gning means; 

sorts the items of phoneme data in order of 
decreasing power and assigns a power-related penalty on 
the basis of tne order obtained by sorting, in such a 
manner that a/ small penalty is assigned to phoneme data 
whose power /Ls close to an average value; and 

sorts fche items of phoneme data in order of 
decreasing/ phoneme duration and assigns a phoneme- 
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i.ated penalty on the basis of the order 
sorting, in such a manner that a small 
Assigned to phoneme data whose phoneme 
close to an average value, 
9. The appkratus according to claim 1, further 
comprising : 

alternate retrieval means for retrieving phoneme 

Satisfies some of the retrieval conditions in 
e phoneme data that conforms to the retrieval 
in said retrieval means does not exist; 
ing means for grouping phoneme data, which has 
eved by said alternate retrieval means, on the 
phoneme environment, and counting the items 
data on a per-group basis; and 



penalty or 
counting 



second penalty assigning means for assigning a 



f 



the basis of a count obtained by said 
eans to the phoneme data retrieved by said 
alternate/ retrieval means, this penalty being assigned 
in addition to the penalty assigned by said first 
20 penalty assigning means. 

Ijy: The apparatus according to claim ^ wherein the 
retrieval conditions include phoneme environment; and 
said alternate retrieval means retrieves phoneme 
data which agrees with part of a phoneme environment 
25 specified in the retrieval conditions. 

7 

wherein the 



specified in the retrieval conditions. ^ 
The apparatus according to claim^Jrd^, 
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phoneme environment specified in the retrieval 
conditions is a triphone composed of an applicable 
phoneme and phonemes on both sides thereof; and 

said alternate retrieval means retrieves phoneme 
5 data for which the applicable phoneme and its left side 
phoneme agree with the retrieval conditions, or phoneme 
data for which the applicable phoneme and its right side 
phoneme agree with the retrieval conditions. 
12, A speech! synthesizing method comprising: 
10 a storage step of storing plural items of phoneme 

data; / 

a retrieval step of retrieving phoneme data, in 
accordance wtLth given search retrieval conditions, from 
the plural iJtems of phoneme data stored at said storage 
15 step; I 

a first penalty assigning step of assigning a 
penalty that is based upon an attribute value to each 
item of phopeme data retrieved at said retrieval step; 
and 

.2 0 a selection step of selecting, from the phoneme 

data retrieved at said retrieval step, and based upon 
the penaltjy assigned at said penalty assigning step, 
phoneme d^ta employed in synthesis of a speech waveform. 

^ J I 

. The method according to claim J^, wherein said 
25 storage step stores respective items of attribute 

information together with the plural items of phoneme 
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data ; and 

said first penalty assigning step obtains an 
attribute value from the attribute information stored at 
said storage step. 

1^. The method according to claim wherein the 
attribute information includes phoneme label, phoneme 
boundary, fundamental frequency, power and phoneme 
duration . ^ ^ 

The method according to claim ^yl , wherein said 
retrieval step retrieves phoneme data that satisfies a 
spej&ified phoneme environment. 

. The method according to claim >2 , wherein said 
retrieval step retrieves phoneme data that satisfies a 
specified phoneme environment and fundamental frequency. 



LClame 

The method according to claim ^ , wherein said 



first penalty assigning step sorts retrieved phoneme 
data based upon a prescribed attribute value and assigns 
a penalty value on the basis of order obtained by 
sorting, 

18. The apparatus according tp claim 12, wherein said 
first penalty assigning step a(s/5j_gns a penalty using 
power and phoneme duration of 
as the attribute values . 

19. The method according to claim 18, wherein said 
first penalty assigning step: 

sorts the /items of phoneme data in order of 



^ch item of phoneme data 



specit:j.ea m cne retrieval conaitions. 

The method according to claim y 




The method according to claim^^-^, wherein the 
retrieval conditions include phoneme environment; and 

said alternate retrieval step retrieves phoneme 
data which agrees with part of a phoneme environment 
5 specified in the retrieval conditions.^ 

wherein the 

phoneme environment specified in the retrieval 
conditions is a triphone composed of an applicable 
phoneme and phonemes on both sides thereof; and 
10 said alternate retrieval means retrieves phoneme 

data for which the applicable phoneme and its left side 
phoneme agree with the retrieval conditions, or phoneme 
data for which the applicable phoneme and its right side 
phoneme agree with the retrieval conditions. 
15 ^23. A storage medium storing a aontrol program for 
causing a computer to execute speech synthesis using 
phoneme data, said control program having: 

code of a storage step of /storing plural items of 
phoneme data; 

2 0 code of a retrieval step/ of retrieving phoneme 

data, in accordance with given search retrieval 
conditions, from the plural /items of phoneme data stored 
at said storage step; 

code of a first penally assigning step of assigning 

2 5 a penalty that is based udbn an attribute value to each 
item of phoneme data retrieved at said retrieval step; 
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decreasing power and assigns a power-related penalty on 
the basis of the order obtained by sorting, in such a 
manner that a small penalty is assigned to phoneme data 
whose power pLs close to an average value; and 

sorts tihe items of phoneme data in order of 
decreasing phoneme duration and assigns a phoneme- 



duration-re 
obtained by 
penalty is 



ated penalty on the basis of the order 
sorting, in such a manner that a small 
assigned to phoneme data whose phoneme 
duration i^ close to an average value. 
20. The meithod according to claim 12, further 
comprising : 

an alternate retrieval step of retrieving phoneme 
data that satisfies some of the retrieval conditions in 
a case where phoneme data that conforms to the retrieval 
conditions / at said retrieval step does not exist; 

a counting step of grouping phoneme data, which has 
been retrieved at said alternate retrieval step, on the 
basis of a phoneme environment, and counting the items 
of phonemp data on a per-group basis; and 

a second penalty assigning step of assigning a 
penalty o[n the basis of a count obtained at said 
counting Istep to the phoneme data retrieved at said 
alternate retrieval step, this penalty being assigned in 
addition to the penalty assigned at said first penalty 
assigning step. 
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and 

code o^a selection step of selecting, from the 
phoneme data r^rieved at said retrieval step, and based 
upon the penalty assigned at said first penalty 
5 assigning step, phonescie data employed in synthesis of a 
speech wavefo3rm. 

24. The storage medium according to claim 23, wherein 
said control program further has ; 

code of ^n alternate retrieval step of retrieving 
10 phoneme data /that satisfies some of the retrieval 

conditions iln a case where phoneme data that conforms to 
the retrieval conditions at said retrieval step does not 
exist ; 

code jbf a counting step of grouping phoneme data, 
15 which has /been retrieved at said alternate retrieval 
step, on the basis of a phoneme environment, and 
counting /the items of phoneme data on a per-group basis; 
and 

code of a second penalty assigning step of 
2 0 assigning a penalty on the basis of a count obtained at 
said coiunting step to the phoneme data retrieved at said 
alternate retrieval step, this penalty being assigned in 
addition to the penalty assigned at said first penalty 
assigming step. 
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